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knowledge 



In general terms, it is desired to assemble many sipall 
sections of raw audio and video ccntent (i.e. sound e 
and video clips) to form a finislied audiovisual produ 
by way of an authoring proce 
environments a considerable degree 

and time must be invested in tire authoring process 
order to achieve a desirable finished audiovisual 
These problems are exacerbated 

product has a complex navigations L structure or 
many separate raw content objects 



As a simple example, a 



program typically has a 

navigational sequence of individual scenes. By 
it is now desired to develop new categories of 
products which have a much moi 
structure, such as a movie with 



different movie endings, and/or wliich have a large number 
of individual scenes, such ae a: interactive quiz game 
with say one thousand individual ciuiz questions. 
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complex 
many scene choice 



An optical disc is a convenient storage media for 
different purposes. A digital versatile disc (DVD) 
been developed with a capacity of 



up to 4.7Gb on a sirgle- 



in 

:t. 



ion 



or 



many 
has 



04-NQV-03 07:29 | 



4. NOV, 2003 1 9:25 



HARRISON GODDARD FOO 



15 



20 



25 



30 



sided single -layer disc, and up t< 
double- layer disc. There are pre 
formats for recording data onto a 
video , DVD- audio , and DVD RAM, am< 

DVD - video i s part i cular ly intlfended for use 
pre-recorded video content, such a 3 a motion picture, 
a result of the large storage capacity and ease of Ase, 



DVD discs are becoming popular and 
Convenient ly, a DVD- video disc is 



commercially important, 
;i>layed using a dedicated 



10 playback device with relatively simple user controls, 



DVD players for playing DVD -vie bo discs are becoiiing 



widespread, 



More 



detailed 



relatively 

information concerning the DVD-jjrideo specification 
available from DVD Forum at www . dvi Lf orum . org 



Although DVD-video discs and 
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17Gb on a double-sided 
ently several different 
iVD disc, including IVD- 
pgst ethers. Of these, 

with 
As 



becoming popular and widespread, a: present only a limited 
range of content has been develc ?ed- in particular, a 
problem arises in that, although 1 he DVD specification is 
very flexible, it is also very complex. The process! of 
authoring content into a DVD-vid^o compatible format is 
relatively expensive and time consuming, in practice, the 
flexibility and functions allowed in the DVD-vLdeo 
specification are compromised by the expensive and rime 
consuming authoring task. Cons equ ant ly, current DVD-vLdeo 
discs are relatively simple in their navigational 
complexity. Such simplicity can i npede a user's enjoytient 
Of a. DVD-video disc, and also inhabits the development of 
new categories of DVD-video produc 



and 



background 
is 



DVD- video players 



An example DVD authoring 



are 



WO 99/38098 
interactive 



(Spruce Technologies) which provides 
graphical authoring \ interface and 



b*e - 



tool is disclosed 



in 
an 
data 
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management, engine* This known 
relatively knowledgeable and 
encounters difficulties when att 
audiovisual product having a 
structure. In particular , despitj^ 
user interface, the navigational 
DVD-video product must be expl 
author. Hence, creating a DVD-vide|f> 
navigational structure is expena 
error -prone . 



authoring tool require 
exj >er i enced operator 
empting to develop 
complex 

providing a graph 
J t rue t tire of the dee 
^citly defined by 
product with a co 
Lve i t ime - consuming 



»d to present movieii 



audio/ vi ?ual 



UVDs represent one of the fastest growing forms 
multimedia entertainment throughout the 
Conventionally, DVDs have been us 
users using extremely high quality digital 
content- Figure 14 shows, schenieitically, a typical 
entertainment system 1400 compris} 
DVD 1404 and a television 1406. 
number of programs and cells 108 

corresponding digital audio- visual- content 1410 
with respective navigation data 1*3 12- The navigation 
1412 is used by a navigation eng Lne 1414 within the 
player 1402 to control the order cr manner of 
of the digital content 1410 by a i resentation engine 
T^he presentation engine 1416 presents the digital 
1410 on a television or monitor 



visual content 1418. As is well Known within the art, the 
rendered audio-visual content 141 5 r conventionally, takes 
the form a movie or photographic t tills or text associated 
with that movie; bo -called Bonus ; fieatures . 
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>m|blex 
and 



of 



wo::ld« 



ng a DVD player 14 0:* 
The DVD 1404 contains 
each of which co 



A user (not shown) can us^ 
associated with the DVD player 



presentation 



1416. 



content 



1406 as rendered audio- 



a remote control 
1402 to influence 
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operation of the navigation engirs 1414 via an infrexed 



remote control interface 1422* 
infrared remote control 1420 and 
1414 allows the user to make vari 



dus selections from 
5 menus presented by thfe presentation engine 1416 under 



control of the navigation engine L14 as mentioned above 



. Due to the relatively limit^jel 
might form the navigation data, 
by the DVD pi ayer and , in partjji cul ar 
engine 1414, is relatively simple 
responding to infrared remote 
retrieving and displaying, via 
1416, pre-authored or pre-detertnidied 
content 1410. Beyond decoding an< . 
audio-visual content 1410 as rendered 
the EVD player 1402 performs relatively 
processing . 



Thi s can be cont ras ted 
sophisticated real-time processing 



with the relatively 
performed by compu : er s 
20 when providing or supporting a dtaphical user interface 



(GUI) such as that represented or 



members of the family of Win lows operating sys 
available from Microsoft Corporation. Figure IS depi 
schematically, a GOl 1500 presented by, for examble, 
internet Explorer, running on tie Windows 98 operating 
system. The OUT 15 0 0 comprises ai 
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the navigation engine 
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the 



any 
the 



set of commands 1:hat 
tjjhe processing performed 
the navigal : ion 
and largely limited, to 
control commands and 
ifhe presentation engine 
digital audio -visual 
presenting the digital 
visual content 1418, 
little real- ':ime 



with a menu bar 1504. The menu tar 1504 has a number of 



menu items 1506 to 1516 that can 



presented by all of 



using- a mouse and cursor or corresponding hot-keys a? is 



30 well known within the art. 



Selecting one of the 



items 1506 to 1516, typically, caiees a pull-down mem to 



be displayed. Figure 16 depict* 



3e selected individually 



the 
zexns 
zts, 



application window 



a pul 1 - down menu 



1502 



menu 



1600 
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corre spending to the tt Pile* menu 
seen that the pul 1 - down menu 1 6 0 i 
further menu items, B New" 1602 to 
be selected to perform correspo; 
the further menu items; namely, tt N 
invoke or produce further, respect 



As will be appreciated, the 
and the various menus, pull -down 
in real-time, that is, the 
displaying and stepping through 
presented is performed in real- 
inetruction set of a microprocessor 
sufficiently sophisticated and 
Internet Explorer application 150(1 
perform the necessary calculatio] ls 
implement the display and selec 
response to user commands issued ife. 



pr messing 



time. 



It will be appreciated that t lis is in stark contrast 



to the operation of menus and the 
using current DVD players. Aii 
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item 1506. It carf be 
comprises a numbez} of 
*Close" 1604, that can 
f vine t ions - Twq of 
1602 and "Send" i.606 
ve, menus (not shown) 



menu items are selected 
otherwise, are invpked 
necessary 
the various menu 

Effectively, 
of a host compute^ 
lexible to imbue 
with the capabilit 1 
and manipul at i on£ 
bion of menu items 
real-time . 



the menu options and the mode 



applications , 

presentation of those options o:l: 

currently relatively crude and unsophisticated „ This 



at least in part/ due to most DVD 
perform, in response to a user 

real-time processing necessary to display 
sophisticated menus and, subsequently, to select a 
item from such displayed menus. IChis is due, in part 
the" very limited additional graphics element processing 



30 capacity offered by current DVD pi 



those DVD players 



selection of menu itieme 
compared to cotrrp Jiter 

of 
is 
is, 
fe to 
the 
such 
menu 
to 



players being unabl 
action or command, 



ayers , 
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It will be appreciated that tne panes illustrated 



figures 15 and 16 have been shown 
limitations of DVD players become 



considering providing dynamic menu:* with content that 



change or is dynamic For 
diaplayable within a pane might 
digital images such as photographs 
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as lacking content. 



of the present 
of the problems of the 



It is an object of embodaUments 
invention at least to mitigate some 
prior art. 

Summary of invention 

In a first aspect of the pre sent invention there 
provided; an authoring method fcfpc use in creating 



component s itnpl ic : . t 
of audiovisual consent 
content objects, ard a 



15 audiovisual product, comprising the steps of: defining a 
plurality of components, the components implicitly 
representing functional sections 
with respect to one or more raw 
plurality of transitions that represent movements between 
the plurality of components; expiijiding the plurality of 
components and the plurality of transitions to provide a 
set of explicitly realised AV assets and an expanded 
intermediate data structure of nodias and links, where 4aeh 
node is associated with an AV asset of the set and the 
links represent movement from one node to another? and 
creating an audiovisual product iji a predetermined output 
format, using the AV assets and tie expanded intermediate 



aven more apparent vhen 
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in 
The 



example , the cont ent 



be video or stills 
or the like. 



can 



of 



is 
an 



data structure of the nodes and 
audiovisual product comprises data 
of emulating at least one menu. 



the links , wherein 



representing or capable 



the 
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audiovisual 



In one preferred embodiment, 
relates to authoring of 
compliant: with a specification 
be recorded on an optical disc 



f or 



In a second aspect of the 
provided an authoring method for 
video product, comprising the 
plurality of components 
sections of audiovisual content 
transitions representing movement 
expanding the plurality of 
transitions to provide a set of 
data structure of nodes and 
associated with an AV asset of 
represent movement from one node t 
a DVD-video format data structure 
using the nodes a*d links, where, 
data structure comprises data 
emulating, at least one menu. 



recording 



pre sent 



repr ka ent ing 



component 



lin;S 



In a third aspect of the 
provided an authoring method 
audiovisual product according 
specification, comprising the ste > 
of AV assets each comprising a 
audio ob j ects and zero or more sub 
expanded data structure of nodes 
node is associated with one AV 
links represent navigational 
another; azid creating a DVD-videf 
from the set of AV assets, using 
method characterised by the steps 
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the present invention 
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content into a form 
DVD -video and abl4 to 
medium. 



invention ther* 
use in creating a 
steps of* creating 
parameter-: 
and a plurality 
s between 
s and the pluralit 
assets and an 

where each node 
the set and the 
5 another; and 

from the AV 
n the DVD -video 

or capable t 



as 
3VD- 
a 

sed 
Of 

components ; 

Of 

expanded 
is 
links 
creating 
assets, 



reps e sent ing, 



fo: mat 



of 



present 



invention therq is 
use in creating an 
to a DVD -video 
of: generating a set 
object, zero or ttiore 
picture objects, and an 
and links, where ?ach 
of the set and the 
from bne node to 
format data structure 
nodes and links; the 
>f : creating a plurality 



fcr 



vie; eo 



movement 



the 
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of components and a plurality o: transitions, wher-s a 
component implicitly defines a plurality of AV assets 
referring to a presentation template and to items of 
content substitutable in the presentation template, 
the plurality of transitions 
movements between con^onents; and 
of components and the plurality of 



the set of AV assets and the expanded data structure 



nodes and links, wherein the setj 
expanded data structure of nodes 
representing, or capable. of emulat 



present 



In another aspect the 
provided a recording medium 
15 computer implementable instruction 
the methods defined herein. 



invent ion there 
having recorded thereon 
s for performing any of 



In yet another aspect of the 
is provided a recording medium 
audiovisual product authored 
methods defined herein. 



Advantageous ly g embodiment $ 
and simple method and apparatus 
25 visual product. 

Preferred embodiments provide 



by 
raw 
and 

r epre s ent naviga t i Ana 1 
expanding the plura: - ity 
transitions to 



generate 



of AV assets and 
^nd links comprises 
ing, a menu. 
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of 
the 



data 



is 



ac ::or 



C in 



able to create an audio-visual product having a cotrplex 



navigat ional structure and/or 
30 content objects, whilst reducing 



pre sent invent i on £ ler e 
recorded, thereon an 
■ding to any of 



hairing 



convenient 



provide a 
for authoring an aufciio- 



a method and apparatus 



! laving many indivi dual 



the 



authoring 
operators . 



and minimising 



ne sd for highly skiJlled 



a time required 



for 
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preferably, there is provided 
is intuitive to use and is highly 



an authoring tool 
flexible - 



embodiments 



Particularly preferred 
audio -visual products suqh as DVD 
on commonly available DVD-video 



pi s y era 



menu 
with 



According to a further aspect 
provided an asset authoring method 
providing a data structure compris 
structure having at least one 
number of menu item© associated 
views of, or actions in relation 
asset ; providing a visual 
automatically, a number of visua 
one of the visual assets provided 
structure j the visual assets 
respective views of the defined 
provided or reflecting respective 
actions in relation to the visual 



Advantageously, embodiments o 
allow menus, in particular, pull 
with viewing content to be real is 
is , the embodiments allow the 
and invocation of menu items 
at least emulated- 



reel 



support creatior 
video products that 



NO. 639 



that 



of embodiments ther«> 
comprising the steps i 
.ng data defining a 
having a 
a number of 
to, a general 
^sset; and creat 

assets using at 
knd the data of the 
corresponding 
of the visual 
actions of the def 
ksset provided. 



ca eated 



va ews 



is 
of 
menu 
respective 
def :_ned 
visual 
:Lng, 
loast 
data 
to 
asset 
Ined 



the present 
-down menus , 

on a DVD player 
-time display of 
by computers 



invention 



associ ated 



that 



performed 



A further aspect of embodiments of the 
invention provides a method of authoring visual 
the method comprising , the stei of creating a 
sequence comprising data to display a progressively 
expanding menu comprising a number of menu items 
invocation of a selected menu item or a user-c 



cont ent 



video 



folic wing 
-generated 



P. 15/95 



of 
run 



menus 
ta be 



present 
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A still further aspect 



present invention provides a method of authoring visual 



content; the method comprising t 
video sequence comprising data to 
contracting menu comprising a 

following invocation of a selected menu item or a ijser 
generated event - 



NO. 639 



of embodiments of 



P. 16/9 



ie step of creating a 
display a progressively 
number of menu it ems 



the 



Brief Description of the Drawings 



invention will now 
with reference to 



be 
the 



a. component used as :?art 



Embodiments of the present 
descried, by way of example only 
accompanying drawings in which: 

Figure 1 is an overview o : an authoring method 
according to a preferred embodiment; 

Figure 2 is a schematic di Lgram showing a simple 
abstraction of a desired audiovisual product; 

Figure 3 shows in more detail 
of the abstraction of Figure 2; 

Figure 4 illustrates an example prior art authoring 
method compared with an example pr sf erred embodiment ; 

Figure 5 depict© another example embodiment of 
present authoring method using components and transitions? 

Figure 6 shows the example o: Figure 5 in a tabular 
format ; 

Figure 7 is an overview of 
components and transitions; 

Figure 8 depicts evaluation 
detail; 

Figure 9 shows evaluation 
detail ; 

Figure 10 illustrates a port 



a. method for evaluating 
of components in 



structure during evaluation of components and transiti 



the 



transitions in 



Lon of an expanded 



more 



more 



data 
one ; 



• 
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of creating 
detail ; 



Figure 11 is an overview of 
creating DVB-video structures f 
structure ; 

Figure 12 shows a step of erea|ing DVD video 
locations in more detail? 

Figure 13 depicts ■ a step 
compatible data structures in more 

Figure 14 ©hows a home entertai nment system; 

Figure 15 shows a GUT for internet Explorer? 
Figure 16 depicts a pull-down 

Figure 17 shows schematical 
process according to an embodiment of the 
invention; 



NO. 639 



a preferred method 
com an expanded 



for 
data 



structure 



DVD-v:.deo 



i teiru of the GUI; 
.y an asset 



Figure 18 depicts a data 
according to an embodiment; 



struc :ure for defining a menu 



Figure 19 shows, schematical; 
expansion and contraction of pull 
embodiment s of the present invention 



Figure 20 illustrates data f oi 
2 0 used in the video sequences of 



Figure 21 illustrates the 
menu, data for the pull -down 
sequences of figure 19; 



Figure 2 2 depi c t s the di spl ajp 
video sequences together with the 
sub-picture menu data; 



authoring 
present 



y, video sequences [ for 
down menus according to 



a pull -down menu 
fidlire 19; 



generation of sub-picpure 
the lus used in the 



of the frames of 
schematic overlay of 
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t<5 be 



vadeo 



the 
the 
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Figure 23 shows the relations!! 
having menu item overlays and 
sequence or frame 7 



Figure 24 illustrates the frames 
for the expansion and contraction 



Figure 25 illustrates the g 
menu item according to an embodiment 



Figure 26 shows menu data 
sequence showing the progressive 
10 of the further menu shown in figurjk 



Figure 2 7 depi c t s the 
graphical overlay of a sub-picture 
item of the further menu shown In 



NO. 639 



p between a sub-picture 
a corresponding video 



of 



of a video sequence 
the further menur 



aeration of a further 



:or generating a v:.c 
Expansion or contraction 
25; 



P. 18/95 



deo 



Figure 2 8 shows a f ir st 
15 visual asset according to an 



flowchart for generating a 
; and 



embodiment 

Figure 29 shows a second flowchart for generating a 
visual asset according to an embodiment. 

Detailed Description of the Prefer red Embodiments 



Figure 1 shows an overview 
according to a preferred 
invention. The embodiments of 
applicable when authoring many 
content or products, and in 
navigational structure or content 



As one example, embodiments 
are applicable to authoring of 



lationship between 
to a corresponding 
:igure 25; 



emboiiiment 



of an authoring mejthod 
of the prejsent 
a present invention 
types of audiovisual 
particular when con|plex 
are involved. 



<pf the present invention 
jvideo - on- demand proc uct s 



a 

tnenu 
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are 



delivered remotely from a service provider to a user, fiuch 
as over a computer network or ckher telecomrminicati.ons 
network. Here, the embodiments oij present invention 
especially useful in authoring interactive products, where 

talayback of the product 



5 user choices and responses during 



dictate navigational flow or content choices 



Jys another example, embodijhents of the present 
invention are particularly suitable for use in 
authoring of an audiovisual product or audio vi 
content compliant with a DVD -video specification 
example will be discussed in more 



illustrate 



the 



preferred arrangements 



invention. The audiovisual product, 



for 

15 example, recorded onto a medium su|ch as an optical dis^c or 

a 



magnetic medium. The DVD-video 
series of data objects that are ar 
structure, with strict limits on 
objects that exist at each level a 
in one preferred embodiment of the 
desired to create an audiovisual 



of 



ispecif ication defines 
panged in a hierarchical 

the maximum nnrabez 1 
£ the hierarchy, 
present invention i 
product or 



content which meets these and o'lher limitations of 



specification. In particular it 
resultant audiovisual product oajl 
commonly available DVD players 

desired to create the audiovisual product or 
having a complex navigational structure, to increase 
user's enjoyment of the product, and in order to allow 
creation of new categories of audiovisual products . 



In the field, of DVD-video, 



considered in terms of audio -visual assets (also called 



assets or presentation objects) 



the 
fcual 
r 2iis 

etail below in orde:: to 



of 



present 



or content can be, 



audiovisual 



is desired that 
content will play 1 
However, it is 



audiovisual content' 



According to the 



He ice, 



: is 



the 
the 

on 



aiso 



conjtent 
a 

the 



is 

AV 



DVD- 
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contains at least 



one 



video object, zero or more audio objects, and zero or more 



sub-picture objects- That is, a section of video data 
presented along with synchroniJed audio tracks 



optional sub-picture objects, 
specification allows up to eight 
{audio streams) to be provided in 
nine video objects (video streams 



streams represent different camera angles, whilst 



audio streams represent different 



soundtrack such as English, French, Arabic etc. Usually, 
only one of the available videc 



is 
and 



The current DVD -video 
different audio tracks 
association with u£ to 
Typically, the v: 



language versions c f a 



and audio streams 



deo 
the 



is 
is 



selected and reproduced when thf. DVD-video product 
played back. Similarly, the currint specification allows 
15 up to thirty- two sub-picture streams, which are used for 
functions such as such as language subtitles. Again, 
typically only one of the sub-picHure streams is selected 
and played back to give, for example, a movie video olip 
with English subtitles from the sub-picture stream 
20 reproduced in combination with a Prench audio stream. 3ven 
this relatively simple combination of video, audio 
sub-picture streams requires a 
ordination and effort during a 
finished product such as a feature movie. Hence, due to 
25 the laborious and expensive nature of the authoring 
process there is a strong disincentive that inhibits 
development of high-quality aiidiovisual products 
content according to the DVD- video 
then an even stronger impediment 
30 of audiovisual products or 

navigational flow or using high niimbers of individual 
content objects. 



high degree of 
athoring to * achieve 



and 
co- 
ca. 



the 
or 

specification. There is 
against the develop ment 
content with conplex 

raw 
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Conveniently , the authoring m 
the present invention are impleme 
suite of programs. The program or 
stored on or in any suitable mediu3)a 
storage such as a magnetic disk r 
memory card, or as a signal modulated 
transmission on any suitable dat^t 
Interact - 



In use, the authoring method 
a computing platform, like a general purpose 
platform such as a personal computer or a client - 
confuting network. Alternative 
implemented, wholly or at least 
authoring hardware- 



NO. 639 



or 



ethod of embodiment 
i Lt ed as a program 
programs are recorded: 
, including a 
d disk or solid 

onto a carrier 
network, such as 



tjarc 



removable 



state 



s suitably performed on 



computing 



eeirver 



.sua 1 
hicjh 



As shown in Figure 1, the 
preferred embodiment of the pres 
three main stages, namely: 
abstraction (or storyboard) 
sections of a desired audiovi 
automatically evaluating the 
create a fully expanded intermediate 
of AV assets in step 102? and 
structure compliant with a DVD^v 
the expanded intermediate structure 
103. Preferably, the output 
recorded onto a recording medium, 
digital linear tape that can be 
video product using glass master 
of the digital linear tape, 



the method may 



in part , by dedicated 



ceuthoring method of 
3nt invention 
creating a high-lfevel 
epresenting 

product in step 
-level abstraction 
structure and a 
- creating an output 
deo specification 
and AV assets in 
structure can 
such as, for exampl 
used, to create a 
(jhreated using the coiitent 



dsita 



coittpr ises 



f uncti anal 
LOl; 
to 
set 
data 
using 
step 
then 
e, a 
IDVD- 



P. 21/95 



of 
a 
or 



for 
the 



be 



the 
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The method outlined in Figure 
in more detail. 

Firstly, looking- at the step 
high-level abstraction is created 
of components that implicitly 
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L will now be explained 



101 of Figure 1, the 
by forming a plurality- 
represent functicnal 



P. 22/95 



elements of a desired DVD- video pipduct or content, and a 
set of transitions that represent movements, that [is, 
navigation, between the components 
playback. 



that will occur during 



Figure 2 is a schematic digram showing a simple 
abstraction of a desired audiovisual product or content. 



In the example of Figure 2 there a|e three components 2 
linked by two transitions 202 U The components 



represent functional elements of the desired audiovisual 

portions 



product, where one or more 



(combinations of video clips, audi 



of A.V content 



a clips, etc) are to 



01, 
201 



be 

reproduced during playback. The transitions 202 indicate 
legitimate ways of moving from oi e component to another 
during playback. in the examp'le of Figure 2, the 
transitions 202 are all explicitly defined. Suitally, 
each transition 202 is associated with an event 203, which 
indicates the circumstances giving rise to that 



25 transition. An event 203 is a triggering action such 



the receipt of a user command, or the expiry of a tiijer, 
that influences movement througli the sections of 



AV 

Referring to Figure 2, startling 
from a particular component A, ind given all possible 



content during playback. 



30 



actions, exactly one event 2 03 will 
a transition 202 from the current 
component B or C. 



as 



be satisfied, allowing 
component A to a njext 



0084861 1o4-Kiov-03 07: ?9 j 



4. NOV. 2003 1 9:29 



-HARRISON GODDARD FOO 



10 



15 



20 



25 



30 



17 



The preferred 6mfc>odiments 
types of component . These are an 
choice component and a meta-compon^pt 



pafcvide three different 
:,nf ormation component I 



inf orraa :ion 



raw 



iects 



An information component r< 
course become a single AV asset in 
product * Suitably, an 

comprises a reference to a 
collection of raw content obj 
audio clips, itnags stills or othef: 
will be used to create an AV 
product* For example, an 
a welcome sequence that is 
product is played in a DVD-video p 
sequence is to be played each tim^ 
desired to display the welcome 
to the next component . An 
can also be termed a simple 
to define presentation data in 
product • 



asset 



inf ormat (Lon 



displayed 



sec uence 



inf or pat ion 



component) 



A choice component represents 
plurality of AV assets in the desi 
In the preferred embodiment, 

(alternately termed a multi- 
reference to at least one raw 
more parameters. Here, for 
present a welcome sequence in 
languages, dependent upon a 
both a speaker's picture (video 

(audio stream) are changed 
playback language. Conveniently, 
used to represent a set of 



NO. 639 



what wil 1 becora£ 
red audiovisual product, 
the oho ice c ompoj len t 
c&rrponent) comprises i 



what will in |due 
the desired 

component si 
content obj ect 
(I.e. raw video 
digital content) 
in the audiovie 
component refers 
when the DVD- 
ay er. The same 
playback begins. It 
, and then 
component 
is used principally 
the desired DVD-v$deo 



audiovisual 
nply 
or 
and 
tlhat 
ual 
to 
vildeo 
welqome 
is 

proceed 
(wtach 



P. 23/95 



consent object, and on«| or 



e, it is desiredi 
one of a plurality 
parameter . That 
stream) and voice t±*ack 
to the desired 
a choice component, 
AV assets in 



exaihpl 



language 



according 



des ired 



to 
of 
is. 



is 
the 
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IB 



eventual audiovisual product or 
one or more parameters is used to 
member of tlie set. Hence, a 
mainly presentation data in a 
content, but also represents son* 
(i.e. selecting amongst different 
according to a language playback 



P. 24/95 



iistinguish between 

component represents 
DVD-video produe:lor 
navigational struc 
available AV asfeits 
parameter) , 



a procedural ly-def 



A meta- component comprises 
structure representing a set of | information components 
and/or a set of choice cotnp 
transitions. Conveniently, a me 
define subsidiary met a- components 
used principally to define naviga 
desired audiovisual product 
components and transitions. 



Lried 



(jnents, and associated 
z a - component may it , 3el f 



A met a -component 
-ional structure in 
representing o 



Figure 3 shows a choice c 
component 201 in more detail* The 
following one of a set of 
labelled Ti (Un) , and is left by 
outgoing transitions Tofl.jn) . 
transitions 202 might comprise 
incoming transition. The set 
might comprise one or more than 



cm] 



iponent or information 
component is reached by 
inc joining t rans i t ions i 2 02 , 
pllowing one of a se : of 



ona 



The component 201 is defined with reference to zero lor 



more parameters 301, which are 



authoring process. However, the component 201 may also 



defined with reference to zero 02 



302 



Bach variable 302 records state information t h at 



=sach 



f 

hi 



is 
he 
er 



The set of incoming 



One 



one or more t han 
<j?f outgoing transitions 
outgoing transition- 



used only during 



more runtime variables 



be read and modified within the ijcope of each component, 
during playback of the audiovisual product or content ; 3 uch 



the 



can 
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as in a standard dvd player 
201 is provided with a label 3 
during the authoring process 



Conveniently 



03 



items 



asset 



or 



The component 201 contains re 
items of content 304. The 
multi-media objects (still pictinjk 
audio clips, text data, etc.) 
source storage systems such as a 
content management system, or 
any suitable format such as, f 
*bnrp, . txt, » rtf , - jpg, . mpg r . cjtf 
amongst many others. It will he 
content objects are not nece$3ar, 
format suitable for use in the 
which demands that video , audio 
are provided in selected prede 
MPEG) . 



file 



Each component 201 uses the 
index which allows that item of 
from the source storage systems 
explicit (e.g. an explicit 
determined illicitly, such as witl 
the parameters 301 and/or variahl 
parameters 301 and/or variables 
explicit file path) . 



Conveniently, the component 
comprises a reference to a template 
provides, for example f a defin: 
layout x and format of a desired 
be displayed on screen during pi 



NO. 639 



the compo aent 
for ease of hand Ling 



more 
raw 



rerences to one or 
of content are 
e images, video 
recorded in one or 
file system, 
management sy s t em k 
example, .gif , 
*mov, .wav, . rm, 
appreciated that these 
ly at this stage ib., 
Ijj VD -video specif icat 
and sub -picture obj 4 c ta 
termined formats (i.e. 



clips, 

more 

i 

database, 
in 

Wfr 

ijaw 
a 



re f eranc e$ as a key 
content to be 
The references may 
path) , or may 
reference to values 
as 302 (i.e. using 
302 to const ruct 



or 

i 

retrieved 

toe 

I 

be 

i 

.of 

i 

the 
an 



201 also preferably 
3 05. The template 
tion of presentatif< 
auction of AV content 
ayback* A template 



P. 25/95" 



dn. 



305 
on, 
to 
305 



I 
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10 



draws on one or- more items of content 304 to populatJ the 
template. Typically, one template 305 is provided for 
each component 201. However, a sikgle template 305 may! be 
shared between a number- of compoalents 201 or vice versa. 
A template 305 is provided in any! suitable form, such] as," 
for example. As an executable tjcogram, a plug- in or| an 
active object. A template is com leniently created ueiug a 
programming language such as C++, visual Basic, Shockwave 
or Flash, or by using a script Luch as HTML or Pythpn, 
amongst many others. Hence, it wi|ll be appreciated thf* a 
template allows a high degree 



of flexibility in 



15 



20 



25 



the 

creation of AV assets for a DVd- video product or content. 
Also, templates already created Jor other products < SU ch 
as a website) may be reused directly in the creation I of 
another form of audiovisual prodjlct or content, in ]this 
case a DVD- video product content. 

The parameters 301, runtime jvariables 302, corient 
items 304 and template 305 togetJkr allow one or morl AV 
assets to be produced for use in the desired audiovisual 
product. Advantageously, creating a component 201 in this 
par-ameterised form allows a number! which might be a ikige 
number, large plurality of AV afsets to be represented 
simply and easily by a single component. 



advantages of creating 



30 



To illustrate the power and 
components 201 and transitions a|o2 as described ablvT 
reference will now be made to Figure 4 which compares a 
typical prior art method for authoring an audiovisual 
product or content against prefe:jred embodiments of the 
present invention. ln tMe eXa ,L>ie, it is desired .'to 
develop an audiovisual product wifich allows the user] i t o 
play a simple quiz game. 
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15 



21 



audiovisual 



In Figure 4a, each AV asaet 40 
present in the eventual 
created in advance and navigat 
defined using navigation links 
Here, the game involves answering 
answered correctly, then, answering 
answer to each question is 
runtime variable such that one of 
correct, whilst the other two 
simple example of Figure 4a it 
number of assets need to be 
number of navigational links, 
relatively expensive and time 
errors . 



product must 
dLbn between the as$ 



represented by arrows 402. 



f first question and 
a second question. 



randomised at runtime usirgi a 



In 



created 



J_OQ 



the t 



Figure 4b shows an abstract i 
transitions as described herein, 
game. It will be appreciated 
20 in Figure 4b remains identical 
questions increases to ten, 
number of questions, whereas the : 
4a becomes increasingly complex as 



twent y 



which it is desired to 



answers A, B and Cj lis 
incorrect . In this 
be seen that a ln^ge 
with an even greiitier 
Hence, the process lis 



be 

At3 



if 
The 



consuming, and is prone to 



using components and 
for an equivalent cfruiz 
the abstraction shown 
javen if the number : of 
, fifty or some o^her 
epreseatation in Figure 
each question is adaed 



25 Figure 5 shows another exajnple abstraction u^ing 

components and transitions. Figure 5 illustrates! ,an 
example abstraction for an audiovisual product or content 
that will contain a catalogue of [goods sold by a retail 
merchant. A welcome sequence 

30 information component 201a. Choi 
used to provide a set of similar 
such as summary pages of product 



detailed product information including photographs 



goods sold by a 

is provided as 
ze components 201b 
sections of AV 
Information or pages. 
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moving video for each product in t 
catalogue contains, for example, 



ie catalogue. Here, 
of the order of 



P. 28/95 



thousand separate products, each oE which will result 
separate AV asset in the desi::ed DVD-video prodJtct 



5 Meta-components 201c provide functions such 



selection of products by category 



the 



one 



in a 



as 



- | 

These meta- components are procedurally defined. 



name or by part code 



Figure S shows a tabular 
10 abstraction shown in schematic forJn 



representation fear- 
in Figure 5. 



In use, the authoring method 
presents a convenient user 
components and transitions of the 
Ideally, a graphical user interfa 
the definition of components, 
similar to the schematic diagram 



conveniently, the user interface provides for 
graphical creation of component e * uch as by drawing btixes 
and entering details associated 



the 



the 



and apparatus suitably 
interface for creating 
high-level abstraction. 
3e is provided allowing 
transitions and events, 
of Figure 5. Host 

the 



with those boxes. 



defining transitions by drawing alrrows between the bixes 
and associating events with those arrows. Alternative!: f\ a 
tabular textual interface is provided similar to the tjible 
of Figure 6. 



Referring again to Figure 1, 
in step 101 is itself a useful 
abstraction may be stored for 



transferred to another party for fjirther work. However) ,in 
so niosti cases the authoring method s|e used to automatically 
create a final audiovisual product or content, such as a 



and 



i 

the abstraction created 
output . The created 
later use or may be 



DVD- video product, from the abstra 



. :tion. 
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Referring to Figure 1, the 
the step 104 of checking for 
specification- It is desired 
resulting DVD-video product will 
output specification, in this 
specification* For example, the 
has a hierarchical structure wi 
maximum number of objects that 
and limits on the maximum quant i 
stored on a DVD -video disc- 



In one embodiment , the checkirg step 104 is perfoirmed 



NO. 639 



method optionally includes 
compliance with a DVD 
predict whether the 
conform to a deeared 
case the DVD-video 
DVD- video specif icat^ljon 
:h strict limits on • a 
xttfy exist at each le^l, 
y of data that can be 



using the created components 201 end transitions 202. 
discussed above, the components 2<jl contain reference* 

»4 aiid " " 

, thfifc 



raw AV content objects 304 
authoring parameters 301, 3 02 



produced. The checking step 154 j comprises predict in 
required number of objects at each level of 
hierarchical structure, by considering the number 
potential AV assets that will be produced given 



possible values of the authoring parameters 
authoring-only parameters 301 and runtime variables 302) , 
and providing an indication of whether the limits for 



Id templates 305, 



allow AV assets to be 



P. • 29/95 



As 

ito 
and 



i 



1st- a 

the 
;of 
the 
i Je. 



maximum number of object© will b 
where a component defines a set of 
it is useful to predict the physi 
and to check that the audiovie 
expected to fit within the avail 



the 

exceeded . Simila: rly , 
similar AV assets, :hen 
al size of those assets 
product or contentf is 
abl e capacity of a 



disc. Advantageously, the conformance check of step 
i : s performed without a detailed realisation of ever} 
asset, whilst providing an operator with a reasonably 
accurate prediction of expect ad conformance, J If 

non- conformance is predicted, the] operator may then pake 



DVD 
i04 
AV 
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Steps, at this early stage, to remedy the situation- 
result/ it is possible to avc 5 d unnecessary time 
expense in the preparation of a 
which is non- conformant . 



As shown in Figure 1, in steji 102 the components 



and transitions 202 of the high 1 



As a 
and 

cull audiovisual pre duct 
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5vel abstraction 200 



The components 201 and transitions 202 



evaluated in any order. However, but it is convenient: to 



first evaluate the components a: Id then to evaluate 
transitions* Ideally, any net a- components in 



abstraction are evaluated first . 



results in new components and traditions, these are edded 



to the abstraction until all nujt a -components have 
evaluated, leaving only inf oi mation components 
parameterised choice components. 



automatically evaluated and exparded to create AV assets 
and an intermediate data_structi:re of nodes and links. 
Figure 7 shows th*=s step 102 of Ficjure 1 in more detail 



may 



201 

are 



be 



Where a me ta~ component 



An expanded intermediate data 
represent the abstract components 
in the new evaluated form* This 

comprises branching logic derived from the events ^ 
attached to the transitions 202 | (which will eventually 
become navigation data in the deAred audiovisual prcjduct 
OX- content) and nodes associated 
from, the components 2 01 (which 



30 



presentation <data in the audiovisual product or contJnt) , 
However, it is not intended ifaat the expanded data 



structure is yet in a suitable 



structure is created' to 

i 

201, and transitions 202 
expanded data structure 

203 



audiovisual product in a restricted format such as a 



with AV assets deiived 
wi 1 1 eventual ly become 



the 
the 



been 
and 



form for creatine; • an 
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video product, since at this stage 
onto the hierarchical structure ajad 
the DVD-video specification- 



Figure 8 ©hows step 701 of Fig 1 ire 7 in more detail 
explain the preferred method for evaluating the 
2 01. As shown in Figure 8, each information component 
and each choice component 2 01b is 

801. Each component 201 is evaluated to provide one 
more AV assets in step 802 



component 



In a:^ information 
this evaluation cottiprises creating an AV asset from 



of 



referenced raw content objects 304 

this evaluation step comprises evaluating a template 
and one or more raw content objects 304 according to 
authoring parameters 301/302 to 
assets. suitably, a node in the 
is created to represent each AV 
step 804/ entry logic and/or ex; 
represent a link to or from each 

asset is reached or left undftr appropriate ruaj: 
conditions . 



NO. 639 



there is no mapping 
other limitations 'of 



componcait 



In a choice component 



Figure 



shows 



preferred 



provide a set 
expanded data 
asset, at step 803 
t logic is created 
node such that each 



L:ing 

^rcaisxtioae in step ^02 of Fig.7.| Each transition 20:>!is 

902 



25 selected in any suitable order in 



the conditions of the triggering e rant 203 associated 'd,th 
a particular transition 202 are used to create e:itLry 
and/or exit logic for each node of the expanded <iata 
structure. In step 903, explicit links are provfded 
between the^ nodes . 



structure 

At 

■ 

'to 
|AV 
jjme 

I 



method f or erval ua : 



step 901. In step 



F i gur e 10 is a schema t i c 
201 during evaluation to create 



illu stration 



of a 

set of nodes 110 



component 
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AV 



sach 



04SNOY-03 07:29 



4. NOV. 2003 1 9:31 



HARRISON GODDARD FOO ' 



10 



30 



26 



NO. 639 



P. 32/95 



134 



associated with an AV asset 120, together with entiy lcgic 
132 and exit logic 134, defining movement between one rode 
110 and the next. The entry logic 
reference runtime variables 3 02 whj 
playback (e.g. timer events, play 
states) , and the receipt of user 
the evaluation step consumes eac 
parameters 301 associated with 
201 , such that only the runtime 
actions such as timer events and u 



Referring again to Figure 1, 
step 105 may, additionally or 



a conformance checking 
alternatively to the 
checking step 104 , be applied following the evaluation 

raction* in step 102, to 
produce the expanded data structure 100 allows a iiore 
accurate prediction of expected compliance with 



15 step 102* Evaluation of the absl 



particular output specification, 
of the expanded data structure r 
20 such that the total number of 
locations can be accurately predi 
assets has been created, allowing: 
of the capacity required to 
Conveniently, information about 



132 and exit logic 
ch are available during 
sr status, and playback 
bmmands . Convenient ly , 
of the authoring -only 
|he abstract components 
iables 302 and runtime 
er commands remain. 



or 



25 conformance i$ fed back to an operator. Changes to 



non- 
the 

structure of the product can then 3© suggested and raad^in 
the abstraction to improve complia ice 

Referring to Figure 1, in steb 103 the easpanded ,iata 
structure from step 10 : 2 is used to create an audiovisual 
product according to a predetem ined output format, .'in 
this case by creating specific structures according fA a 
desired DVD-video specification 



n particular, each nbde 
^presents one AV as*5£t, 
AV assets and object 
jsted, and the set o£ AV 
an accurate prediction 
hold these assets. 



conformance 
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Figure 11 shows an example me -hod for creation of 
DVD video structures - In step ll|pi, the nodes 110 in 
expanded data structure are plac 
an order of the abstract compone: 
nodes originated, and in order o: 
components to adjacent components 
a result, jumps between DVD 

during playback are minimised localised to 

playback speed and cohesion, 



etn, cture 



Each node is used to create 1 
location at step 1102. Optional 
number of created DVD video 
the specified limit set by the 
then creation is stopped at 1104 
Assuming the number of structures 
limit then DVD video compatibly 
Created at step 1105. Finally, a 
created at step 1106. 
available tools are used to perfoxfln 
be described in detail here. 



in a list, such 
ts 201 from which 
the proximi ty of 
in the abstraction . 
Leo s t rue t ur e 1 oc a 



in 
tjhose 
qhbse 
i As 



txons 



improve 



the 



exceeds 



a DVD video structure 
y r at step 1103 if 

locations 
DVD-video 
and an error 
is within the specified 

data structures 
DVD video disc irnagt 



specification 



reported 



are 

iis 



Conveniently, commercially 



step 1106 and need 



Step 1102 is illustrated in more detail in Figure 
In this example variable T represents a number of a video 
title set VTS (ie. from 1-99) whilpt variable P represent© 
a program chain PGC (ie. from l 

title set. As shown in Figure l2L the nodes 110 of 
expanded data structure 100 are U3ed to define locat 
in the video title sets and program chains. As 
available program chains within efrch video title set 
consumed, then the locations move 
set. Here, many alternate methoda( 



the 
the 



j 

not 



12. 



999) within each v^deo 

the 

the 
are 

to the next video t:.tjle 
are available in order 
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to optimise allocation of physical 
of the expanded data structure . 



Step 1105 of Figure 11 is ill istrated in more detail 



in Figure 13 . Figure 13 shows 
creating DVD-video compatible dati 
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locations to the ncdes 



a preferred method 
structures by plac: 



the AV assets 120 associated with each node 110 in 



structure location assigned for th 
links between the nodes with 



pcplicit references 



destination locations. At step -!307 this results in 
explicit DVD compatible data structure which may thex, be 

disc 



used to create a DVD disc image, 
image is used to record a DVD di 
product - 



t node and substituting 
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for 

ing 
tjhe 



Finally, the DVD 



;c as a new audiovisual 



Figure 17 shows an authoring process 1700 aceonling 



present 
M r of 



invention 



sets of assets 



to an embodiment of the 
automatically producing a number, 
1702 to 17 06 from corresponding assets 1708 to 1712 aid a 
data structure 1714 defining a i tenu structure havirfgj a 
number, N, of menu items 1716 to 1T720. 



Also, the 



only selected menu items, if appropriate, have associated 
data 1722 to 1726 representing a : graphical manifestation 
or representation of the menu items, 
items, or only selected menu iteris, have associated 
processing operations 1728 to 11,33 that perform, o^ 
least provide access to functions that can perform, 
processing operations or manipulations upon the provided 
assets 1708 to 1712 to produce thfc sets of assets 170p to 
1706, It will be appreciated 

assets 1708 to 1712 represent a realisation of one or 

Addi t i onal ly , 



The menu items 



raw content objects described a]|ove. 
alternatively, at least one of tV 



that the corresponding. 

more 
or 

graphical data 172)2 1 to 



:to 

'an 



for 



or 



nenu 
data 
j at 
data 
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172 6 and the data processing 
represent embodiments of raw cont 
content objects are preferably 
using respective icons, which, 
5 embodiments of the components 



IS 



20 



30 



raw 



Operating 1728 to 
ant ob j ect s * These 
represented graphically 
themselves , repre sent 
above. 



desc ribed 



In preferred embodiments, t± a user interface of 



authoring tool that implements 
presents a component that represc nts a hierarchical 



system, called *Menu Component' 



10 parameterised with information tliat defines each of 



items within the menus together with associated 
destinations/ if appropriate, thit it references to 



functions or operations that are 
items. The menu component lb 
authoring process into nodes and 
comprise respective start, 
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1732 



the 



the authoring met hods 
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menu 



The menu component j is 



Associated with the 
expanded dur ing 

inks in which the nodes 

■ i 

and and intermediate 



representations of a corresponding menu to allow it to be, 



for example, progressively opened 



or closed. 



It can be appreciated that tlie sets of assets 1702 to 

For example, the ^irst 



1706 comprise respective assets. 

set of assets 1702 comprises several visual assets 1734 
1738 that were produced, from t] ie first asset 1708 
applying appropriate or selected 



the 



the 
menu 
the 



available operations 1728 to 173 I according to the 



25 structure, that is, according to 



intended to be available for that first asset 170B- The 
assets 1"?34 to 173 Q created are g iown, for the purpose of 
a generalised description, as h iving been created [from 



menu items that have operations 
associated with them. The operat 
operations associated with corresponding 
selected from the N illustrated toe nu items 



operations of 



to 
by 
the 
menu 



whether a menu iten- is 



A, B and C (not sfcojwn) 
ions A, B and C wiljlj be 
menu litems 
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Appropriate or selected 
Rations 1728 to ;.732 
that is, according! J to 



second asset 1710. The assets 1 "'40 to 1744 created aire 
shown, for the purpose of a generalised description J as 
having been created from menu items that have operations 



10 P, Q and R (not shown) assoc: 



operations P, Q and R are" assocj ated with corresponiing 



menu items selected from the KT 
The same applies to the Mth set 



comprises respective assets 174S 1 3 1750 produced from 



15 Mth asBet 1712 and selected operat 



Navigational data 1752 to 1 
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assets 1704 comprises 



were produced, from 



the 



Similarly, the second set o^ 
several assets 1740 to 1744 that 
second asset 1710, by applying 
operations of the available op 
according to the menu structure 
whether a menu item is intended ttb be available fox- that 
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ated with them. 



The 



illustrated menu it 3ms* 
of assets 1706, wiieh 



,ons 1728 to 1732. 



options might relat^ 
image processing techniques Sue i as ^posterising 
image. Therefore, in this examp .e, the links associated 



68 is also cheated 
one embodiment , 
of 



for 

the 
data 



each asset 1734 to 1750. 

navigational data represents da embodiment 
contained within the expanded intermediate data structure 

20 of nodes and links. The navigational data is arrange to 
allow the navigation engine 1414 cf the DVD player 1402 ( to 
obtain the next image or video sejuence, that is, created 
asset, according to the memi stricture, 
the first asset 1734 of the first set of assets 

25 represents an image, the navigational data associated 
that first asset 1734 may coxnpr: 
asset 1736, which might represent an image or "\Jideo 
sequence showing that image toget aer with the progressive 
display of a number of menu options associated with 

3 0 image- For example, the menu 



the 



that 
to 

'the 



1 
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with the second as s e t 1736 might 
thi rd ^sB6t { not shown ) 
with the progressive closing or 
options previously displayed via 
a link to a fourth asset showing a 
the original image shown in the 



represenl ing 



t he 



TtlL 



■on 3 



It will he appreciated t iat the assets 
represent stills or video sequences. In 
embodiments/ the assets that relat s to the menu opti 
menu items are video sequences tl at show the progres 
expansion or contraction of the mpnus. 
additionally, the assets might coi uprise two portions 
a first portion representing a vi ieo sequence arranged 
display or hide the dynamic men i and a second 
representing a still image or a 
that is arranged to loop, that : 

repeat once the menu ha© been dismayed or hidden* 



NO. 639 



to 



togetJde 



comprise a link 
the image 
• rontraction of the 
first asset 1734 
posterised* versio^L 
asset 1708, 



or iginal 



a 
r 

T)nenu 
of 

I 



ght 

preferred 



i or 
£ive 
or 
with 
to 



portion 



with 



Figure 18 illustrates 
structure definition in the form 
structure will be described 
structure to perform image -proc 
number of images. It will he a; 
the purpose of illustration only 
the present invention are not 
1800 comprises a root node 1B02 at 
displayed in irs original 
Selecting "OK", for example, us 
1420 , might be intended to cause 
for displaying the menu options 
the menu structure. It can 
example that invoking the' "OK" 
intended to produce a pull -down 



grapl: ically 



further video 
s, that is arranged 



a possible kuerru 
a tree 1800. Hie 
re £ erence to a 
seeing techniques 
ppa|eciated that this is 

and that embodiment^ 
liifcdted thereto* The 
which an asset 
dr unadulterated 
ing the remote 
a transition to a node 
available at that level in 
appreci at ed from !the 
button or the lik£ 1 is 
menu having four nleiau 



le 
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sequence 



! tO 



data 
menu 

for 

i 

: of 

tree 
be 



migtt 



florm. 
coritrol 
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items 1804 to 1810* in the example, the four menu items 



are ~ Act ion* 1804, *Zoom w 1806, 
1B10« At this stage in tie menu 



displayed asset will be intended ;o also comprise a pill 



5 down menu showing those options 
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n Pan" 1808 and *Efffect v 
Structure, an originally 



ftrith those menu options 



having been progressively displayed via a corresponding 
video sequence. In order to select the menu options, sub- 
picture data is intended to be generated shown graphic 
overlays for each of the menu itens ^Actions" 1804, "Zoom" 



1806, tt Pan* 1808 and ^Effect * 
appreciated that the links between 
the menu structure shown in figuj: 
be represented by embodiments 
transitions described above . 

It can be appreciated that 
defined such that selecting the 



1810 



It will 



the nodes and leaves' of 

! 

a 18 represent or could 
of the plurality 



be 



produces a further menu comprisi:ig a number of sub- 



. of 



I 



the menu structural 
first menu option 



the sub -menu items 
1816, * Previous* 
Again, the 



is 
1804 
menu 
are 
llais, 

s 

menu 



items. In the illustrated example 

*First" 1812, ^Last" 1814, *ttext 

^Thumbs" 1820 and 'Category* 1*22. 
structure is arranged to have sub-toicture graphic overlays 
associated with each of the options that can be used! to 
select the options- Video assets are intended to ] be 
produced that give effect to operations associated (with 
these options 1812 to 1822. 



Selecting the *First" 1812 option is intended 



display a first image of a aumbe:| of images. Therefore, 



an asset displaying that first ; mage is intended t\> 
.produced- Selecting the second bption, "Last* 1814 
intended to display the last image of the number 
images* Therefore, an asset fo 
will be produced using the last 



to 



be 

is 
of 

: displaying that image 
image. The "Previous" 
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tre intended to display 



vi 



1816 and ^ISText" 1818 menu items 

previous and next images respectively. Suitably, 
assets giving effect to the disp|a.y of the previous 
next images are intended to be 
^Thumbs* 1B20 is intended to display thumbnail views 
all, or selectable, images within a category or set 
images. Again, selecting this ?ption will necesei 
producing a video asset that displays all of the thumb 
views or a selected number of these thumbnail views, 
can be appreciated that any view of an asset might 
associated navigation data to jurr? to the video aseej: 
sequence showing the thumbnail views. The final opt 
^Category" 1822, is arranged to present a further sub 
containing a number of categories of image; 
represented by a corresponding renu item 1824 to 1 
Selecting one of these menu item* is intended to 
the first image in the category cf images or a numbe|r 
thumbnail views of the images witlin that category 



The menu structure might 
second menu item, "Zoom" 1806, 
having four zooming options? 
"100%" 1832 and *200%" 1B34, 
intended to produce zoomed 
Suitably, giving effect to invoca 
182 8 to 1834 will require co 
f i r st ly , to di splay the menu 
give effect to the trans it ior 
starting, view of an asset to a 
together with corresponding na 
navigation engine 1414, in 
presentation engine 1416, to 
assets showing such zooming 



defined such that 
broduc ee a further 



nanu ly, 1828, 1830, 



which, when selected, 



P. 39/95 



.deo 
and 



i It 
need 
or 
ion, 
menu 
each 
826. 



display 



:! of 



the 

i 
i 

rrtenu 



are 



versions of an original a^set. 

i 

ions of these menu items 
inesponding video assefts, 
options and, secondly, ; to 



from an initial 



zoomed view of the a^set 
Lvirjation data to allow jthe 
conjunction with jthe 
retrieve and render the -rideo 
operations. Again, a sub- 



or 
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picture having appropriately posi 



that are selectable and maskable i ill also be desirabl 
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ioned graphical ovei'lays 



£ub- 
l's42 



The *Pan" 1808 menu option produces a further 
menu comprising four menu items or options 1830 to 
that are arranged to allow a usei to pan around an irnalge 
Accordingly, for each original as i let, various video assets 
need to be defined that support such panning. Simile rdy, 
the final menu option, "Effect' 1810 r i© arranged | to 
produce a further sub-menu comprising three menu 4 terns 
1S44 to 184 8 that apply image processing technique 
effects to the original assets. 



items are "Colour* 1844, w Bla :k & White 



^Posterise" 1848, which require 
the original assets in colour, in 
posterised forms respectively, 

data would also be required to support selection of 
menu items 1844 to 1848. 



40/9 



The illustrated 



1846 



s , or 

1 

menu 
and 



video assets to present 
black and white and in a 
pgain, sub-picture 4^9^ 

the 



25 of members of the set of explicitly realised AV assets 



the associated navigation data aUpresent embodiments ' of 



the links associated with the expanded intermediate 
structure . 



30 



It can be appreciated from tile above that marshalling 



or producing the assets in preparation for creating a 



that uses, or at least emulates. 



the assets produced, or 
effect to traversing the 
tems can be still inages 



It will be appreciated that 
intended to be produced, to give 
menu structure and invoking menu : 

or video sequences representing a dynamic transition from 
one view of an asset to another v: ew of an or the asset: or 
representing a transition between views of an asset. ' It 
will be appreciated that such ass< ts represent embodiments 



and 



data 



dynamic menus requires a 



DVD 
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very large number of assets to 
all possible combination* of 
number of menus and menu opt ionjb 
menus defined in the data 
corresponding assets that 
contraction of the menu items e 
with respective asset data wil 
number of assets to be generated. 



asse t 



st ow 



created that antic 
views according 
or items within 
structure . Furthered; 
the expansion 
jointly or 
also require a 



it her 



prod 



element 



Referring to figure 19, ther§ 
an authoring process 1900 for 
sequences 1902 and 1904 comprising 
the expansion and contraction 
assuming that the menu structure 
arranged to define a pull -down 
represent embodiments of 
explicitly realised AV assets des 
video sequence 1902 has been 
purposes only, as comprising fi^{ 
The first frame 1906 is a s 
image shown in figure 15. In 
only the menu bar 1504 and 
figure 15 have been illustrated iij 
frame 1908 is shown with a 
menu 1600 having been displayed, 
third and fourth frames 1910 
illustrate progressively larger 
the pull-down menu 1600- The 
the complete pull-down menu 1600 
itflage shown in figure 16 . The 
expanding portions 1916 to 192 0 o 
are illustrated as expanding on 
that is, each portion contains a 



are 



mefiu. The video sequences 



schemat Lc 



tl e 



winds iw 



portion 



fine! 
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:.pate 
to jtha 
fliose 
re, 
or 

severally 



large 



is shown schematic laCLly 
ucing a pair of video 
frames that i llust rate 
of a pull -down njenu, 
and menu items 



of 



the 



3 of the sets 
bribed above. The ifl^st 
i^hown, for illustrative 
e frames 190 6 to 1|914 
representation of 
intere s t s of c 1 ar i ty , 
1502 of the imag^ j of 
each frame* The sebpnd 

1916 of the pull- 
It can be seen that 

and 1912 respectively 

i 

portions 1918 and 192 ) j of 
frame 1914 illustrates 
and c orre sponds to 



down 
the 



progressively iner-easinj or 



1600 



the pull -down menu 
a per menu item babis, 
greater number of nenu 



the 
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rather than the full 13 menu itL shown in figure 
However, it will be appreciated that a pull-dawn nehu, 
according to requirements, may p.resent any predetem ined 
number of menu items. The progressive scansion 



P. 42/9. 



i 



item, as corded to a previous Ltian. Again, foJ : th e 
purpose of clarity of illustration only, the pull-down 
menu i 600 has been shown as comprising four menu items 



contraction of the menus corresponds to or emulates 
revealing or hiding of menus within a. windows center. 



10 



Although figure 19 illustrates the creation 



individual frames, it will 



be 



preferred embodiments the visual Lssets 1906 to 1914 



15 



(frames, that is, 
asset 1906 will, 



! in 



take the form of a number of 
sequences. For example, visua 
practice, represent a video sequence comprising a nuiber 
of frames that progressively displays the first portion 
1916 of the menu over a predetermined period of time. 1 it 
will be appreciated that the number of frames const itu:ing 



20 



such a video sequence might be a 
display speed for the menu. 



Navigation data 1922 to 192 



16. 



and 



appreciated that 



' of 
,' in 



urill 

j 

vadeo 



video assets and allows the navigation engine to retrieve 



25 



the first video sequence or sJt of video assets 
sequences 1902 from the DVD 1 104 and to cause 



presentation engine 1416 to dilplay the first vj. deo 



sequence using that retrieved dati 

1922 to 1928 represents a realisat ion of the links of 
expanded intermediate data structure of nodes and link*: 



The second video sequence 1904 
30 been shown, for illustrative purposes 
five frames 1930 to 1938. The 



function of the desired 



provides links between 



. or 
the 



The navigation £ata 

the 

i 



of figure 19 has kso 
only, as comprising 

i 

fir-st frame 1930 iej a 
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image 



schematic representation of the 
in which the pull -down menu 1600 
form. The second frame 1332 i 
portion 1940 of the pull -down 
displayed. It can be seen that 
frames 1934 and 193$ respective!^ 
smaller portions 1942 and 1944 of 
The final frame 1938 illustrates 
menu 1600 in its most contracted 
the image 1500 shown in figure 
decreasing or contracting portions 
pull -down menu 1600 are illustrate! 
on a per menu item basis, that ii 
progressively fewer menu items a£ 
portion. Navigation data 1946 to 
asset will also be created to 
1414 to retrieve the asset and 
engine 1416 to display that video 
be appreciated that each video as 
practice, represent a video 
embodiment described above has 
frames rather than setjueuoes for 
of illustration only. 



allipw 



It will be appreciated the 
video sequences 1902 and 1904 hav<i: 
the purposes of clarity only. Ifti 
panes will contain content such 
data or video sequence data. 



It will be appreciated that 
30 menu has been described with re 
contracting on a per menu item b 
real i s ed in which any 



NO. 639" 



15 



shown in figure 
j.s in its fully 
i shown with a 
menu 1600 having 
the third and 
display progress 
the pull -down menu 

the complete pull- 
form and correspond! 
15. The 

1940 to 1944 of 
g again, as contrac 
, each portion 
compared to a 
1952 linking each 

the navigation 
cause the 
asset . Again, it 
it 1930 to 1938 will 
sequence and that 
been illustrated 
the purposes of 



expanded 
smaller 



c>een 
fo Lirth 



viiieo 



predei jermined 



ely 
00. 
down 

I to 

progres si^rely 
the 
:ing 
contains 
previous 

video 

i 

engine 
presentation 
rill 

r 1 in. 

i 

fehe 

i 

using 



content panes of 
been shown * empty" 
practice , the 
as, for example, iijnage 



although the pull -frown 
fference to expanding 
sis, embodiments can 
expansion 



P. 43/95" 



16, 



clarity 



the 
for 
content 



and 
! be 
or 
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contraction step size is used, 
that smaller or greater steps 

number of frames that are require^ to form tlie first 
and second 1904 video sequences 
display of the pull -down menu l£0 
that rendering such pre -authored 
first 1902 and second 1904 video 
down menus to be provided, or at 
players, which increases the 



>r the smoothness of 



10 



i progressively expanding 



15 



20 



interfaces for, and the user expedience , of DVDs 

Figure 20 shows, schematically, the graphical 
2 0 00 that can be used to produce 
or contracting pull- down menu 
embodiment . it can be seen that 
13 pull -down menu portion* 20 02 
2002 to 2026 are used to produce 

and 1904 described above with reipect to figure 19. 
complete frame of video may coJrise both the pull 
menu portions or complete menv with or without 
-application* window, such as thai displayed in figure 
together with ot her data or irtormation such as. 



It will he appreciated 
sizes might affect the 

1,902 
the 

It can he appreciated 
video sequences as the 
sequences enables pu-11- 
east emulated, usinc 'dvd 
richness of the 



an 



example, content for the application window and/or 
background on which the applicajipn window sits, i e' it 
does not occupy the whole of the '2 0x480 or 720x575 pixels 
of the DVD NTSC and the DVD PAlJsECAM pixel resolutiohs, 
respectively. The pull-do^n menu portions 2002 to 2,026 
represent embodiments of raw content that are represented 



as raw content objects within the 
Ihe data representing the 



1904, stored on the DVD 1404, will also be accompanied by 



sub-picture data, carried by at 
two available sub-picture streau 



1600 according tc 
the data 2000 comprises 
o 2026. T^hese portjipns 
the video sequences 1902 

A 

down 
.the 
15, 
for 



i 

user 



data 



authoring method, 
ideo sequences 1902 



east one of the thirty 



The sub-picture 



'ara 



id 



data 
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10 



IS 



20 



25 



overlays 



is used to produce graphical 
selected menu items of the various 
down menu. The sub-picture da 
bitmap image bearing graphical 
on top of, or otherwise combined 
sequences . The manner and 
graphical elements are controll 
cor re spondi ng sub-pi c ture 
high! ight s that se lec t ively 

or reveal an associated 
picture data represents an 
the raw content objects described 
images or graphical overlays r 
elements of the set of escplicitly 



overlays 



posd t 



but -ons 



graphical 
embod Lment 



Referring to figure 21, thezf|& is shown schematically 

of 



or highlights for 
menu items of the pull- 
a is used to produ 
that sire 
'frith, corresponding 
ion of display of 
sd or determined 
with 

operated as masks to 
overlay. The 
of raw contenjt 
above and the 
^present embodiments \ 
realised AV assets. 



=e a 
displayed 
video 

,the 

i 

ils-ing 
associated 
hide 
sub- 
t. of 
bi tmap 
of 



selected number 



such that, when 
sequence displaying 



invoked 



the relat ionship 210 0 between 

graphical overlays 2102 to 2108 ai|d corresponding portjions 
2102' to 210S f of the pull-dowi menu 1600* The 
picture buttons or masks associated with each graphical 
overlay 2102 to 2108 are arranged 
in conjunction with the video 

pull -down menu, the sub-pi ctuire bitmaps select i 
highlight or overlay the corresponding portions 2102 
2108' of the pull -down menu 1600. 
1416 , under the control of the 
displays the appropriate sub-pi 

2102 to 2108 in response to useajt commands received 
the remote control 1420 using th<* sub-picture butt 
masks. For example, figure 22 

30 relationship 2200 between three central graphical overlays 



The presentation 
navigation engine 
pture graphical 



2102 to 2106 of a sub-picture 
corresponding menu items 2102' to 



:ons 



{not shown) and 
210S' . Assume that 
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engine 
1414, 



overlay 
from 
' or 
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central graphical overlay 2104 
The navigation engine 1414, in 

'down* user command received CnjL the ir control llftio, 
will cause the presentation engine 1416 to dieplayj a 
selected overlay 2102 or 2106 

setup" 2102' or * Print Previfew" 2106' menu 
respectively by masking the appropriate overlays that 
not required to be displayed. 



is currently displaced, 
response to an *up' . or 



Referring to figure 22, 0 there is shown I the 
io relationship 2200 between a sub- picture 22 02 containing 
graphical overlays 2204 and a v Ldeo sequence or f:rame 
containing the pull-down menu 160 3 in its fully expanded 
state. The sub-picture is not:.onally divided intsi a 
number of regions (not ehown) know i as buttons that can be 



to user actions, l:hat 



These 



15 selectively displayed in response 

is, commands received from the 11 control 1420. 
buttons are used to reveal or hid » a number of highlight 
regions that are aligned with respective menu options of 
the pull-down menu 1600. Figt re 24 illustrates 

20 process 2400 of successive dj 



NO. 639" 



splay of the 



25 



the 
f rimes 

constituting the first and sJtond video sequence's, 
according to the direction of tie time lines 2402 and 
2404. The relationship between tie sub-picture graphical 
overlay 2104 and the corresponding "save Ae» menu item 
804' of the pull-down menu 160 3 can be more easily 
appreciated. 



30 



Figure 25 illustrates a view 
200 with one menu item 2502 of 
having been invoked. It can be 
invocation has produced a further 
embodiments, the further menu 
displayed in a left-to-right mannJr 



P. 46/9 



2500 of the 
tflhe pull -*down menu 
apprec i at ed that 
rftenu 2504 . In 
2504 is 

in a similar- 



application 
ISpO 
this 
prefer tred 
progressive ely 



process 



[0084861 :p^-:Nov-,03 07:29 | 



4. NOV. 2003 1 9:35 ' HARRISON GODDARD FOO ' 



10 



15 



20 



25 



30 



41 



to the progressive display of 



producing a video sequence havi 
menu needs to produce data 13 00 su« 
shown in figure 26. The left- 
comprises a number of portions 2|60 
menu 2504* Each portion 2602 
bigger or smaller than a succee 
respectively- Also shown, in a 
of figure 21, are the sub-picture 



to 2614 that correspond to the reffDective menu items 2(1 

( 4 . The data shown 



t pe pull - down menu :.^00 



NO. 639 



such a left-to-r 
h as f for example, 
-right menu data 
to 2 608 of the 
2608 , is 
g or preceding 

er analogous to 
graphi cal over 1 ays 



ght 
tfcliat 
300 
further 



video sequences 



to 2614' of the further menu 22 
figure 26 is used to produce 

progressively expanding or Conors cting the further 
12 04 in a manner that is substantially similar to 
process used to produce the faJrsff: 1902 and second 
video sequences shown in figure ]L9 



fee 



Figure 27 illustrates, witl 
relationship 2700 between the fuiflther 
sub -picture graphical overlay 261 
mail" 2610' menu item. It can, 
pull -down menu 1600 has been 
selection of the ^Send" menu idem 
the display of the left-to 
corresponding sub -picture graphical 
the start frame 2702 and enqL 
together with intermediate frantbs 
constituting expansion and contact 
according to the direction of this 
respectively . 



0 for the *Page by 



inroked, 



rig: it 



It will be appreciated 
associated with the first video 



that 



progr e ss i^ rei ly 
portion 
tihat 
^610 
IjO' 
| in 
for 

tjhe 

i 

S(04 



greater clarity, 
menu 2704 and 



appreciated that 
, followed by 
2502 , which has c 
menu 2504 and 
overlay 2610. Again 
jErame 7204 are shown 
2706 to 2710, as 
ion video sequeitcies 
ime lines 2712 and 3714 



the navigation qLalta 
sequence 1902 will inc}iide 



P. 47/95 
I 



itself. The authoring process tb produce the data used | in 



the 

i 

tjhe 

s 

jE- 

tjhe 
the 
aitsed 
the 
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a link to the video sequence 
menu 2504 to give effect to 
"Send" menu item 2502 be invoked 

ah example of data of the ejrpjnded intermediate 
stz-uoture . 



30 



It will be appreciated fcrom the above that 
process of marshalling or producing a visual asset 
displaying and using dynamic mskus involves produ 



video sequences for both the expansion and contraction, 



NO. 639 
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fO- expanding the further 
:hi.t expansion should the 
Such navigation dat a. , is 

lata 



the 
for 
zing 



that is, the display and hidiiig, 
together with, navigation data 
video sequences j according no 
user operations and sub-picture 

navigation data for controlling 1 he display of the 
picture graphical overlays. It Jill be appreciated 
such video sequences represent 
assets described above. Also 
represents embodiments of the 
intermediate data structure. 



! 

of the pull -down jnenu 
li liking the frames anijor 
planned or predetermined 
g^pphical overlay data and 

:hat 
AV 
iata 



2800 



Referring to figure 28 thei 
for producing visual 



asfeets according to 
embodiment of the present invention. At step 2802 
original visual asset is provided or obtained, 
original visual asset is an embodiment of raw contact, 



that is # a raw content object 
respective component of the 
described above. A data structure 
of 



menu structure together wi h associated menus 



menu ..iteitis and operations related^ 
defined at step 2304. The data 
manifestation of the plurality 



embodiments of the 
the navigation 



Links of the expanded 



s is shown a flowchart 



t] .at is represented liyf a 



represent movement between appropriate components of 



p .urality of compensate 

i 

comprising a definition 

and 



I 

[an 
! an 
The 



to those menu iteni^ 1 is 
structure represents! a 
cf transitions 



that 
the 



10084861 



04 -Nov- 03 07:29 : | 



4. NOV. 2003* 1 9:36 



HARRISON GODDARD FOO 



10 



15 



20 



25 



30 



43 



plurality of components Such 
described above in relation to 
asset is created, at step 2806 
items and their related op6r« 
originally provided video asspt 
represent a realisation of 
explicitly realised AV assets. 
2 8 OS whether or not all assets 
provided asset have been created, 
step 2808 is negative, proc 
where a further asset is created 
needs or requirements defined, 
defined in step 2804, 



re 



creat'sd 



embodiment 



f o m 



Having created the video 
asset/ navigation data linking fch^i 
intended navigational strategy, 
by the menu structure, is 
navigation data represents an 
the created video assets that 
intermediate data structure, 
navigat ion s t rat egy is ref 1 e cjt e|L 
transitions that represent move ne^jit 
of components. A test, performed 
whether or not there are further 
If the test is positive, proc 
2802, where the next asset to jbd 



data structure has been 
figures 17 and 18. ;An 
using appropriate menu 
anions as well as the 
■the created 
member of the set 
lit is determined at 
ating to the origink 
If the determination, 
j- returns to step 
again, according to 
by the menu struc 



If the test is negative, proces^ 

i 

Figure 29 shows a flowchart 
steps undertaken in steps 2906 
greater detail , The menu items 
video asset are identified and 
menu items and the video asset 



NO. 639 



as^ts 

| of 

i 

step 
ily 
iat 

the 



assets from an original 

assets according 
Yfhich is, again, def 
at step 2810 

of links 
part of the 
Fo|rthe rmore , the 

in the plurality 
between the 
at step 2812, 
a/v assets to proc 

continues at 
processed is 
in|ij terminates. 



easing 



to an 
Lzped 
The 
between 
expanded 
intended 

;of 

plurality 
determines 
ess. 
step 

obtained. 

i 

I 



5j|900 that illustrates the 
a^id 2908 of figure 2 : in 
applicable to a provided 
o|nted at step 2902. The 

are embodiments of raw 

i 

! 
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ure 

i 
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content that are represented as 
count, N, is set to 1 at step 
item, the corresponding operatiori 



the operations 1728 to 1732 jshiwn in figure 17, 



identified. 



In an embodiment , 



representing the menu bperation can be represented ty 



respective component of the 
described above. At step 2908 
provided video as set is proeesbexL 
operation identified at step 2£Q 
portion, or a first portion, pf 
asset - 



At step 2910 f the graphical < ata associated with 



NO. 639 



respective components . A 
2P04. For the Nth nenu 
such as, for example, 



the data or function 



P. 50/9 



are 



plurality of components 



copy of the originally 
using the appropriate 
to create at least a 

an intended Nth video 



Nth menu item is processed to produce a second portion of 
the Nth video asset. The graphical data represe n ts 
embodiment of raw content that is depicted as one of 
plurality of components. The coJrrpjLete or whole of the 
video asset is created using at 
second portions at step 2912 . 
the Nth video asset represent a 



of the set of explicitly realised AV assets 



le&st one of the first 
Tflie complete or whole i 



realisation of an element 



determined, at step 2914, whether there are more menu 



items 



to be processed for* whi^h. corresponding v:. 



assets, derived from the original: 



25 are required. 



y provided video as^et , 
If the determination is positive, 



processing continues to step 2916 
and control passes to step 2 90S 



is considered. 



negative, processing terminates 



processing returns to step 2808 



appreciated by those skilled in 



structure defined in the data 



It 



an 
the 
Hth 
and 

of 



lis 

i 



dec 



where N is incremented 
\l)here the next menu :.tem 



If the determir at ion at step 2 914 



or, more accurately , 
figure 28. ? It will be 
the art that the Atenu 



s t rue t ure might comp: rise 



is 
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sub-menus. Therefore, the process 
complex menu 
applications of 



for such a complex menu structure 

the 



recursive 
flowcharts* 



Although the above embodiments have been described 



within the cont ext of a DVD 
Explorer, embodiments of the pr« 
limited thereto. Embodiments can 
pull -down menus are implemented 



example , the * application" might be intended to 



through an album of photographs 



menu items might control the disp 



or video sequences. Still fjur^er, it will also 



NO. 639 



asset 



of producing the 
might require nesteifl 
steps shown in 



Inte:met 



equivalent of 
sent Invention are 
ob realised in which 
in any context - 



or video sequence© and 



not 
the 
For 
:3tep 
the 



ay of those photographs 



appreciated that the pull -down 



15 corresponding menu bar item. Hpw<iver, the pull-down menu 



can be arranged to appear, at 



position, in response to a user-ge; lerated event. 



However 



been described 
visual assets. 

ion are not limited 
i:an be realised in wii 



with 



The above embodiments hav4 
reference to creating video ox 
embodiments of the present invent 
such an arrangement. Embodiments 

the assets processed and/or produced are audio -visual 
assets. 



emk odiments 



to 



Although the above embodiment 
the context of dynamic menus, 
invention are not limited 
Embodiments can be realised in 
or modeless dialogue boxes, or] 
emulated via correspond video sefrufences , 



menu 



stems frorr. 



a predetermined sc::een 



!3 have been describe^ 
of the 
such an 

, for example, 
cjjther GUI elements, 



which, 



in 



present 



arrangement 



modal 



are 



P. 51/95 



s 
or 

the 

i 



be 
a 



r 

ich 
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It will be appreciated tha- 
in the above embodiments might, 
system or multimedia authoring 
can create the assets. Far examplfe 
data on top of image or video dat« , 
might use Macromedia Flash, 
Af terEffecte. 



Ma ere nt*dia 



Furthermore, it will be 
embodiments of the present 
implemented, where appropriate, 



software can be stored on or in 
example, magnetic or optical disc 
the like. 



For the avoidance of doubt, 
followed by, for example, a nous 
n two or more [nouns] *, that is. 



NO. 639 
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:he video assets 
|se an image 
system by which an 
r to overlay menu 
one skilled in the 
Director or 



ere ited 
processing 
au ;hor 
iipagfc 
art 



apprec ian ed that 
Lnfention are preferably 
using software . The 
ious media such as, for 
or in ROMs, PROMs and 



Adobe 



the 



t ie phrase "one or more" 
comprises *one [noun] f and 
it comprises *at least 



[noun]* and visa versa. Therefore, the phrase "one 
more video sequences* comprises ; one video sequence <Lnd, 



similarly, the phrase *one dr 
comprises one original asset as w^ 
*a plurality of video sequences 
original assets" respectively. 



The DVD authoring method and 
have a number of advantages, 
represent parameterised sections 



allow many individual AV assets 1 to be implicitly defined 
arid then automatically created. Repetitive manual tcLks 
are avoided,; which were previaus^y time consuming. 



expensive and error-prone* 



Ha 



apparatus significantly enhance 
available in existing categories 



one 
or 



more original assets" 
11 as both extending r to 
and *a plurality of 



apparatus described above 
reating components that 
:pf audio visual content 



authoring method and 
the ranga of features 
bf audiovisual products 
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or content such as movie presentations. They also sllow 
new categories of audiovisual prjpducts or content tp I be 
produced. These new categories 



products or content such as quiz 



5 based games, as well as information products suet. ' as 
catalogues, directories, refer en :e guide©, dictionaries 
and encyclopaedias. In each case, the authoring method 
and apparatus described herein allow full use of the video 



ii elude both entertainment 



capabilities of DVD 



and audio 

DVD-video. A user may achieve 
DVD player with ordinary controls 
device - a DVD-video produqt 
navigational content is readily 



is simple, efficient, cost effecti/e and reliable. 



Although a few preferred embodiments have been siown 



and described, it will be appre 



sijitted by those skilled 



the art that various changes ani 



made without departing from the 
defined in the appended claims. 
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based games and puzzle- 



specifications suchj : as 
playback using a stanjdard 
such as a remote control 
having highly compi 
cheated in a manner 



scope of the invention 



orrrorises 



The audiovisual product o 
representing audiovisual contend 
content can be derived, DVD vided 
25 data compliant with the DVD sips sif icati 
storing such data. 



Although the above embodittlenlt 
with reference to tlie product or 
30 a w standard DVD player" , it will 
players can equally well be 
example, software players, set- 
processing or otherwise renderi 



wiich 



xnodifi cat ions might ; 



at least any of 
or from which 
disc image data , o 
on or a 



;s have been described 
content being playabl 
appreciated that 
such as, 
boxes or other mean£ 
tig audiovisual content 



b* 



acc pmrnodated 



tbp 
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and software. 
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The reader's attention is Ail acted to all papers 



documents which are filed concuiirektly with or previoui jto 



this specification in connection 



with this application 
■ inspect ion with 
specification, and the content^ if all such papers 



which 



open to 



public 
content 

documents are incorporated herein 



54/95 



combination of hardware 



J 



All of the feature* disclope 



(including any accompanying claims r abstract and drawings) 



i?y reference. 



and/ or all of the steps of a?ii 
disclosed, may be combined id 
combinations where at least some 
steps are mutually exclusive 



Each feature disclosed 
(including any accompanying claims 



and 

■;his 
and 



i in this specif ica: 



method or process so 
i*ny combination, except 
of such features ani/or 



i n this specif ica c 



may be replaced by alternative features serving the s 



equivalent or similar purpose, 
otherwise. Thus, unless expredsl 
feature disclosed is one exampla 
of equivalent or similar features. 



abstract and drawiigs) 



The invention is not restricted to the details of 



foregoing embodiments. The invention extends to any novel 



25 one, or any novel combination, 
in this specification (including 
abstract and drawings) , or to day 
combination, of the steps of 
disclosed. — 



30 



mless expressly stated 
stated otherwise, each 
>nly of a generic series 



and 



ion 



ion 



ame, 



^ny 



Q'- T the features disclosed 
-any accompanying claims, 
novel one, or any novel 
method or process! ' so 
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Claims 

1 . An authoring method 

audiovisual product or content 4 



coir a 



de f i nin g a p lur ali ty of 
implicitly representing functiojiSL 
content with, respect to one or 
and a plurality of transitions i 
between the plurality of component 



f ©j r use in creating 
comprising the steps 



components 



onents, the 
sections of audiovisual 
r#re raw content obj^< 
that represent 



expanding the plurality 
plurality of transitions to proyide 
realised AV assets and an ebcpj^nded 
structure of nodes and lints 
associated with an AV asset of 
represent movement from one node tjo 



ir g 



creating an audiovisual 
predetermined output format , us 
expanded intermediate data structj 
links i wherein the audiovisuejl 
representing a menu. 



2. The method of claim 1, 

comprises defining at least one 
comprises a reference to a raw 



wherein the defining 
information component 
002 tent object. 



3. The method of - claim ]2, 

denotes a file path to a location 
ob j ect is stored . 



NO. 639 



oE: 



cts, 



moveir ents 



component s and [ jthe 
a set of explicitly 
intermediate 
where each node 
the set and the Ijihks 
another; and 



■ Drc duct 



or content 
the AV assets and 
e of the nodes and 
product comprises 



:|xr< 



wherein the reference 
where the raw content 
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an 



data 
is 

i 

i 



a 
the 
,the 
data 



step 
that 
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defining step comprises defining 
component comprising a reference 



The method of any prece Ang claim, wherein the 



^ i UVJ at lease oi 

concent: object, and at least one' Jittering parameter 



5- The method of claim 4, 

authoring parameter is adapted 
modification of the at least one 



56/9 



at least one choice 
to at least one raw 



wJHerein the at least | one 
toll control a selection or 
rjjkw content object. 



io The method of claim 4 or Ife, wherein the at liast 

one authoring parameter conpa:is|s a runtime variable 
available during playback of the 



7* 



The method of claim 4, 



diovisual product, 
or 6, wherein thJ at 



15 least one authoring parameter cLIrises an authoring -<bm T 

■M«M- *™< of 



parameter that will not be avajil|ble during playbac 
the audiovisual product. 



20 



25 



8- The method of any of claims 4 to 7, wherein (the 

choice component Comprises a r Jf J rence to a presentation 
template and a reference to at lleJL one substitute f raw 
content object to be placed in 
the at least one authoring parametl 

9. The method of any prec 

defining step comprises defiriin 
component representing a e»et 
transitions, 



30 



10- The method ..of .claim 9, 

meta-component is a procedurally 
the set of components and transititns 



tie template according to 



I 1 
pig claim, wherein the 

at least one m^ta- 



of components 



one 



wl erein the at least 
defined representation .'of 



and 
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preceding 



11 . The method of any 

t rans i t i on represent & a permiLs 
component; to another comp onent 



12 . The method of any pre^edflLng 

transition is associated with a 



13 . The method of claim lg 
event is an event occurring 
audiovisual product. 

14 . The method of claim 13 
event is receiving a user comroaijLd 



NO. 639 



claim, wherein 
Lbl e movement f rom 



triggering 



claim, wherein 
event . 



each 
one 



each 



wherein the triggering 
during playback of the 



wherein the triggering 
or expiry of a timer 



15. The method of any 

comprising the step of checking 
the audiovisual product with 
format, u»ing the plurality 
plurality of transitions. 



16. 



The method of claim 15, 



output format 



hierarchical 



limitations on a number of objects that may exist in 



data structure at each level of 



25 checking step comprises predicting an expected numbs:: I of 



objects at a level and comparing !:he expected number 
the limitations of the hierarchical data structure* 



wierein the predetermined 



17, The method of claim 15 Qr 

3 0 step comprises predicting an 

audiovisual product, and comparing! 
against a storage capacity of 
medium. 
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preceding claim, further 
expected conformance , of 
tike predetermined ou[tJ>ut 
<$f c omponent a and t he 

! 



dat a st mcture ha ving 



the hierarchy, and 



16 , wherein the checjting 
expected total size of 
the expected total 
predetermined 



the 
the 



i^ith 



the 

ize 



©to rage 
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18 



The method of any preceding- claim, wherein 



19. 



expanding step comprises, for edqb 
or more of the set of explicill 
s reading and manipulating the 
ob j ects . 
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P. 58/9, 



component, building 
realised AV asset?; 
or more raw con 



the 
one 
by 
tent 



The method of any preceding claim, wherein? 



the defining step comprises 
choice component contprising a 
raw content objects and at leas 
and 



ref brence 



the building step comprises 



selecting one or more raw content objects £rort\ amengst 



one 



defining at least 

to a plural iti?" of 
bne authoring parameter; 



the plurality of raw content 9b: 
one authoring parameter; and 



combining the selected raw 
of the AV assets. 



acts using the at 2 



:ca tent objects to form 



20. The method of claim 19 

25 selecting and combining steps 

plurality of the explicitly r^a". 
one of the components. 



21. The method of any 

30 expanding step comprises: 



east 



one 



the 



I sompr i s i ng repe at ing 

automatically build a 
.sed AV assets front : the 



prdcdaing claim, wherein 



the 
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creating from each one of 
one or more explicitly realise^ 
set of AV assets; 



the 



5 creating the expanded int 

wherein each node represents one 



,te: mediate 



creating a set of links between the nodes . 



between 



10 22, The method of any preqed||Lr*g 

trans ition is a s s oc iat ed 
components, and creating the 
evaluating each transition to 
each of the links being between 

15 first component and a node 
component » 



23 . The method of any preceding claim, wherein 

expa nd ing step comprises evaluatijpg at least one of 
transitions to create exit logic 
one first node, evaluating one cf 
entry logic associated with at JLa 
providing a link between the 
according to the entry logic and 



"NO. 639" 



plurality of Components 
.V assets to provide! the 



data 

asset of the set; 



structure 



tod 



each 



claim, wherein 

first and sejcond 
of links 
one or more lik 
a node created from 

from the sebond 



=r Utte 



comprises 



□ks, 



created 



24. The mechod of claim 23, 

the transitions is associated wilthj 
the expanding step comprises 
event to determine the exit logic 
least first one node. 



25, 



The method of any 



ssociated with at 
he components to 
st one second node, 
irst and second 
ae exit logic - 



comprising the step of checking 



re ceding 



no« 



^herein at least one; 
a triggering event, 
1 avfll ua t ing the 

associated with th€i 



of 

i 

dnd 



triggering 



at 



claim, 
expected conformance 
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the audiovisual product with tfce 
format, using the AV assets anc. tfc e 
data structure of nodes and linJpg 



NO. 639 



P. 60/ 



predetermined output 
expanded intermediate 



10 



2S_ The method of claim 25 , v 

output format is a hierarchical 
limitations on a number of objec 

data structure at each level of | the hierarchy, and 
checking step comprises predict in 
objects at a level and comparing 
the limitations of the hierarchies 



27. The method of claim 26, 



comprises predicting an expected total 



15 



w ierein the checking 



audiovisual product, and compar^c 
againet a storage capacity of 
medium. 



inc the expected total 



28. 



The method of any prece 



20 



assets have ' a data format 
predetermined output format. 



i predetermined & towage 



specified according to 



25 



30 



(ierein the predetermined 
data structure having 
that may exist in the 

the 

an expected number ! of 
ihe ejected number 
data structure 



size of 



3tep 
the 
3ize 



g claim, wherein the AV 



29- Hie method of any preceding claim, wherein th«> 

assets each have a data f'orjpafc according to 
predetermined output format, 
objects are not limited to 
predetermined output format. 



30 



The method of any preying claim, wherein 



predetermined output format is a 



tilst the raw con 
data format of 



r 



•video specif icatioii. 



with 

i 
I 



the 



AV 



the 
exit 

the 



the 



! 

i 
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preceding 



31. The method of any 

assets each comprise a video c^bj' 
objects r and zero or more sub-pic 



precedi 



32 . The method of any 

assets each comprise at least 
eight audio objects, and zero 
objects, according' to the DVD^v; 



date; 



33 . The method of any 

creating step comprises creating 
data structure defined by the 
with objects at levels of the 
the intermediate data structure" 
where the objects in the 
include ob j ect s derived from 
assets. 



hier 



34, The method of any pre<?ei 

predetermined output format is 
and the ere at ing s t ep c orrtp 
structure locations from the 
intermediate dat a structure , 
realised AV assets at the created 
substituting the links of the 
structure with explicit 
structure locations. 




35. An authoring method 

30 video product, con^rising the 



creating a plurality of . components representing 
parameterised sections of audiovisual content, an£ a 



claim, wherein 
act, zero or more 
ure objects. 



:ig 



on[p 
• t 
d 
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the 



claim, wherein thk, AV 
video object, zerfc ■ to 
thi rty-two sub-p i cjtur e 
specification. 



prepedling claim, wherein the 
objects in a 
ji r e fie t e rmi ne d output 

structure , according 
f node s and 1 inks , and 
rchical data structure 
t|hej| explicitly realised AV 



hierarchical 



f onpat 



to 



t 



ing claim, wherein the 
DVD-video specifics ticm 
Tiies creating EVD-vkdeo 
: icdes of the 
placing the 
structure locations , 
anfled intermediate 
ces to the DVD- 



fo:jr use in creating a pVD- 
stjeps Of; 



expa ided 
explicitly 
^nd 
lata 
dec 
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plurality of transitions 
components; 



representing movements between 



expanding the plurality 



5 plurality of transitions to proviL a set of AV ass^ti ,and 



NO. 639 



components and 



an expanded data structure of uoces and links, where 
node is associated with an AV ' aiset of the set and 

node to another; anci 



links represent movement from one 



10 creating a DVD-video format 

assets, using the nodes and 1 
format dat a s t rue t ure compr i &&f 
least emulating, menu data. 



P. 62/9. 



the 



d i.ta 



36. The method of claim 35 

at least one information 
to an item of AV content . 



compor .en 



37 



The method of claim 3 



20 least one choice component compr 



least one item of AV content, an<| at least one paranjeter 
for modifying the item of AV cont 



25 



38. The method of claim 

component comprises a reference 
and a reference to at least J>n 
content to be placed in the ter^p]! 
least one parameter. 



30 



thd 



structure from 
, wherein the DVD-i 
ta represent ing, 



or 



36, comprising creating 
comprising a reference 



comprising creating at 
.sing a reference to at 



39. ,Hie method of claim 37 

component comprises at least 



available during playback of -ax, Audiovisual product :ln a 



^ach 
the 



AV 
i'deo 
at 



, wherein the chbice 
a presentation template 
item of substitutable 
ate according to th£ , at 

i 
I 

38, wherein the choice 
one runtime variable 
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DVD player, and at least one 
available during playback, 



4 0 . The method o f any o f 

creating at least one meta- 
eomp clients and transitions. 



41. The method of any of clairlis 

transition represents a permit ibl 
component to another component J 
associated with a triggering ev<m- 



cj.alj.ms 35 to 39 , compr, 
con^jjonfnt representing a 



42. The method of claim 41, 

includes receiving a user coirrmaijid 



43. The method of any of cljai| 

expanding step comprises t 

creating from each one of tjhe 
one or more AV assets to provide 



wi erei 



creating a seft of links betv 

44. The method of claim 3 

thereon, wherein the expanding 
each choice component to create 
according to each value of the at 



45 . The method of claim 44 

choice component comprises creating 



creating the expanded data st^Kucture wherein each 
represents one AV asset of the settl- 



or any claim 
s|ep comprises 

plurality of AV 
Least one parameter 



"NO. 639" 



authoring parameter 



set 



35 to 40, wherein each 
e movement from one 
each transition being 



n a triggering event 

or expiry of a timer. 

i 
i 

35 to 42 f wherein the 



plurality of compo; 
he set of AV assets ; 



; and 



the nodes. 



dependent 



evaluating 



as sets 



sach 



wherein evaluating 

entry logic associated 
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according to the entry logic an<J tike exit logic. 



46. The method of any of c^adms 35 to 45 , 

the step of checking expected conformance with the 
video format using the created c:ofl ponents and transitions 



with at least one node and/02: evaluating at least 
transition to create exit logic; 5,ssociated with at 
one node, and providing a link between a pair of 



NO. 639 



47. The method of any of c 

the step of checking expected 
video format using the set of AV 
data structure of nodes and links 



use 



15 48. An authoring method 

audiovisual product according to 
specification, comprising the stej s of: 



comprising 



DVD- 



P. 64/9 



one 
lbast 



nodes 



ms 35 to 40, comprising 
nformaace with the DVD- 
assets and the expanded 



generating a set of AV assets 



in creating 



an 



DVD-vildeo 



creating a DVD-video format 
set of AV assets, using the nodes 



the method characterised by 



each comprising a ^ideo 
s and zero or more s.ub- 
data structure of 



object, zero or more audio obje 
picture objects, and an expanded 

and links, where each node is a;3s<ficiated with one AV 
of the set and the links repr^sept navigational 
from one node to another? and 



creating a plurality of corapofjients 
transitions, where a component 
plurality of AV assets by referring 



data structure from 
and links; 

e steps of: 



nodes 
asset 
movement 



the 



and a plural idy of 
impl ic it ly defines , 

to a presentation 
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cent 



template and to items of raw 
presentation template , and the 
represent navigational movements 



expanding the plurality 
plurality of transitions to 
and the expanded data 
representing, or at least 



structmr s 



emulating 



50. A method as claimed in any 
the steps of providing a data 
defining a menu structure having 
a respective number of menu iteu 
of defined views of, or actions 
visual as set ; providing a 
automatically, a number of 
one of the visual asset provided 
structure; the visual assets 
respective views of the defined 
provided or reflecting respeeti 
actions in relation to the visi 



vidua 



vxsua 



sual 



51. A method as claimed in claiin h 
providing the visual asset coraprlis^s 
at least one of image data and a 



52 . A method as claimed in any df 
the step of creating the number 
the step of deriving data from 
to produce the number of visual las&ets, 
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mt svbstitutable in 
.urality of 
itween components; 



transitions 



a] id 



components and 
the set of AV aej&ets 
s of nodes and 
, at least one menu 



lLr*s 



preceding claim conrprip 
s tfjructur e compr i & ing 
t least one menu 
ssociated with a 
relation to, a 
asset; and exeat 
assets using at 

Ethe data of the 
t ed correspond! ng 
- ^.„s of the visual 
actions of the 
sset provided. 



v Ldeo 



0 in which the sten 
the step of provi<jiing 
sequence* 



fclaims 50 to 51 in wjiich 
oflfl visual assets compr; L 
tlte provided visual 



a: 3 
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the 



the 



+ng 
data 
ha ring 
number 
gen *ral 
ing, 
li*ast 
{lata 
j to 
afeset 
def :Lrled 



!of 



ses 
set 
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53. A method as claimed in claim 



deriving data from the provided 
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step of copying data from the prcr Ided visual asset 



54. A method, as claimed in 
deriving data from the provided 
step cf processing the data of 
the number of visual assets 
data of the provided visual asset 



52 in which the stejpi of 



P. 66/J 



v.sual asset comprise! ,the 



cla|m 52 in which the stejpj of 
sual asset comprises the 
tt a visual asset such, that 
COT f p: l ise9 respective modified 



55, A method as claimed in any pf 
10 the step of creating the number 
the step of including, in sele 
number of visual assets, visual 
selected menu items of the number 



55. A method as claimed in any c>£ 
the step of creating the number oi 
the step of creating sub-pictur* 
at least one selectable graphical 
a respective menu item. 

57. A method as claimed in claim 
creating the sub -picture data 
creating, or providing, a number 
elements associated *rith respectiv 



25 



58. A method as claimed in clain 
creating the sub^picture data 

creating a mask for selectively Jisplaying the mimbei of 
selectable graphical elements. 



59. A method as claimed in any of 
the step of creating the number of 
the steps of associating a 



claim© 50 to 54 in wfhich 
visual assets comprtLpes 
jad visual assets of the 
ta representing views j of 
menu items. 

claims 50 to 55 in wijch 
visual assets comprises 
lata comprising data for 
element associated 'frith 



p6 in which the step, of 
lomprises the step jof 
|of selectable graphical 
menu items. i 



7 in which the step of 
comprises the step of 



rlaims 5 0 to 58 in wlLiich 
visual assets compares 
sual asset proceeding 
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operation with selected menu itetfle 
deriving the data for the number 
provided visual asset using 
processing operations. 



60. A method as claimed in any bf 
the step of providing the data 
step of def dining image data or 
a plurality of views of the menu 



61. A method as claimed in cl 
10 defining image data or video 
plurality of views of the 
creating image data or video 
of views of the menu represent 
contracting views of the menu. 



step 



aim H 60 in which the 

dfta associated with 
mekiuB comprises the stei 
dsjta! such that the plural 
gressively expanding 



62. A method as claimed in any 
comprising the step of crea 
associated with, or linking, tljie 
according to the menu structure 
visual assets to he accessed 
according to the menu structure, 

of 



63 ■ A method as claimed in any 
comprising the step of prov^ 
plurality of visual assets? and 
second number o f visual a sset p 
visual assets; the created vi 
respective views of the defined 
actions of the defined actioi^s 
structure . 



'NO. 639" 



of the menu items] and 
pf visual assets froip the 
: respective visual Asset 



claims 50 to 59 in ^rhich 
structure comprisesf the 
eo data associated with 



.dim 



ci sating, 



claims 50 to 61, further 
ing navigational (data 
number of visual as|s£ts 
to allow the numbed 
played or displ 



P. 67/95~ — 



of 
the 

■ of 

[ ! or 



! of 
ayed 



claims 50 to 62 , further 
g a first number ; or 
automatically, a 
using the plurality of 
assets corresponding to 
views oar to respective 

according to the fvenu 

i 
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64 > A method as claimed in any of 



25 



65. A method substantially as 
reference and/or as illustrated iu 
drawings . 



66. An asset authoring system cy 
a data structure comprising date. 
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the step of providing the visual sksets comprises the 
of providing an audio- visual ass et . 



Jclaims 50 to 63 in which 

step 



described herein *rith 
any of the aceompan yi-ng 



68/5 



□rising means to provide 
^pffining a menu structure 
a respective numbei -of 



having at least one menu having 

menu items associated with a number of defined views of, 
or actions in relation to, a g<mjjral visual asset; mmis 

p create, automatically, 
least one of the vi 3ual 



reflecting respective actions of 
relation to the visual asset prcvi 

67. An asset authoring system as 
20 which the means to provide the 



to provide a visual asset; meaner 
a number of visual assets using 
assets provided and the data of I the data structure; the 
visual assets created correspond iiJg- to respective views - of 
the defined views of the vjL«ial asset provided or 
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91. A storage medium as claimed, 
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pd position data to mLs* 
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93. A storage medium as claimed 
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associated maskable position 
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using the data stored on the data 
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relative to corresponding menib 
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